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Abstract 

■ Interacting urns with exponential reinforcement were introduced and studied 

in Launay (2011). As its parameter p tends to oo, this reinforcement mechanism 
converges to the "generalized" reinforcement, in which the probability of draw may 
be or 1 for some of the colors, depending on the current configuration. For a single 
psj . urn, the generalized reinforcement is easy to analyse. We introduce and study the 

generalized interacting urn model with two or more urns and two colors. Our results 
concern the law of the so-called non-conformist urns, and answer in the asymptotic 
0_i sense one of the open questions from the above mentioned paper. 

Si 1 Introduction 
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A common feature of reinforced processes is the definition of transition probabilities in 
terms of a given reinforcement weight sequence (wj)i G Nu{o} £ (M + ) Nu ^ ^. At any time n, 



lO . if a reinforced process X n can jump to one of the I states x±, x 2 , xi that have already 
been visited respectively Ii, J 2 , . . . , Ig times, then for each 1 < k < £ the probability that 
IT) \ it chooses Xk is 

Oi ^ [-^n+i = %k\ Xq, Xi, . . . , A, 1 



(si : w h + w h -\ — iw h 

Since the reinforcement weight sequence takes values in R +) we can note that the 
above probability is in (0,1), or equivalently, that it never takes the values or 1. In 
this paper we generalize the set of possible reinforcement sequences by introducing for 
g3; i, j G N U {0} the possibility for to be "infinitely larger" than Wj, that is allowing the 
values and 1 for the above probability. In this framework, we prove a limit theorem for 
the Interacting Urn Model with exponential reinforcement, introduced by Launay [2]. 

The simplest classical reinforced process consists of a single reinforced urn. Without 
further mention we will assume here and later that the initial time is 0, and that the urn 
is empty at time 0. Suppose that there are C possible colors Ci, c 2 , . . . , c<> At time n, let 
there be > balls of color c&, for each k — 1, . . . , C. Then at time n + la new ball of 
color Cfc is added to the urn with probability 

w Nk 



c 

E 
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The first such process was introduced by Polya in 1930 (0), and since it has been gener- 
alized in a number of ways, see for example the survey by Pemantle [I] . 
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Figure 1: Transition probabilities for a particular realization of a single w-urn at time 12. 



As already mention, the first author recently introduced a multiple urn model, called 
the Interacting Urn Model (IUM), in which the urns interact through shared memory. 
Suppose that a number U £ M of urns is given, and let us fix the interaction parameter p e 
[0, 1]. The dynamics is given as follows: at each time n, each urn draws independently a 
ball either from itself with probability 1 — p, or from all the urns combined with probability 
p. In other words, the higher the p the more memory is shared between the urns. To be 
more precise, suppose that at time n, for each k = 1, . . . ,C and u — 1, . . . , U, there is N% 
balls of color in the urn number u. Then for each u, at time n + 1 we add a new ball 
of color Cfc in the urn u with probability 



c 



+ p 



w N * 
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where N% = J2i< v <u ^k' ls ^ ne total number of balls of color in the configuration at 



time n. 
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urn 1 urn 2 urn 3 



[urn 1 draws a black ball] = (1 — p) 
[urn 2 draws a black ball] = (1 — p) 
[urn 2 draws a black ball] = (1 — p) 
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Figure 2: Transition probabilities for a particular realization of the IUM with U = 3 at time 12. 

For this model, it is proved in [2] that if liminf^oo w i+ %/wi > 1, and in particular if 
Wi = p % with p > 1, then 

• if p > 1/2 all the U urns eventually fixate on the same color ; 

• if p < 1/2 there exist two colors Ci and C2 such that a certain number of urns 
eventually draw a ball of color Ci each time they draw out of all the urns combined 
and draw a ball of color C2 otherwise, while all the other urns fixate on c x . The 
number N of urns that keep drawing balls of both colors is random and observes a 
deterministic bound N < U/(2 — 2p), almost surely (see [2]). 
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An open question from j2] was to determine the law of N. The generalized reinforcement 
weights, will allow us to answer this question (see Theorem 11.31 below) in the asymptotic 
regime p — > oo, provided that U = 2 or that U is an odd number. 

So let us now define the set of generalized reinforcement weight sequence as 

W := (R + x M) NU{0} . 

For w = (wj)i e Nu{o} = (ui,Vi)i e nu{o} G W in the following, we shall use the abbreviated 
formal notation: 

Wi = (ui, Vi) =: UiOQ Vi , V«GNU{0}. 

The symbol oo in this notation is meant to recall the reader of the approximation p l oo' 
in the sense of Theorem 11.41 below. 

If a G N U {0} and B = (& x , b 2 , . . . , b t ) G {J mm (N U {0}) m then we define 

'0 if v a < max v b ; 

Kk<£ 



ir w (a,B) = ^(0,61,62, ...,bi 



Un 



U. 



if v a = max t? 6 ; 

KJfc<i 



Kfc<^ 



1 if f a > max v 

Kk<t 



This quantity should be interpreted as the probability to draw a black ball in an urn that 
contains a black balls and bk balls of color (different of black) for each k G {1, . . . ,£}. 
In particular the probability to draw a black ball among a black and b white balls is: 

if v a < v b ; 
vr w (a,6) := { ^ if v a = v b - 

1 if v a > v b . 

When clear from the context we will simply write it (a, b) = ir w (a, b). 

Remark Note that a classical reinforcement weight sequence (wj)j e Nu{o} £ (M + ) Nu '' -'', 
could be identified with a generalized reinforcement weight sequence (wiOo^jgNu-fo} where 
Ui = Wi and Vi is constant. 

For reasons of simplicity, we will consider from now on the above urn processes with 
only two colors, black and white. In the final section we make some remarks about the 
setting of three or more colors. 

Let us first state some easy to derive facts on the behaviour of a single urn that 
corresponds to the above generalized reinforcement weight sequence. 

Lemma 1.1. (a) If Vi is increasing, the color of the first ball is chosen uniformly at 
random, and then all the balls drawn have the same color almost surely. 

(b) If Vi is decreasing, the color of the ball drawn at even times is chosen uniformly at 
random, and for each k G N the color drawn at time 2k + 1 is almost surely different from 
that drawn at time 2k. 

(c) For each i Q such that t> io < v^ for all i < i , there is almost surely i$ black balls and i$ 
white balls in the urn at time 2i . 
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Proof. Statements (a)-(b) are easy and left to the reader. For (c) denote by Tj the first 
(random) time at which one of the colors is drawn exactly Zq times. Recall that the urn 
is empty at the initial time 0. Suppose WLOG that this color is black. Then clearly 
P(*o < T i < 2«o — 1) = 1 and the number of white balls drawn at time Tj is precisely 
T i — < io- Due to the above assumption on the sequence (t>i)i, at time Tj the urn is 
bound to draw white, and similarly at each time {rj + 1, . . . , 2io — 1} the urn will draw 
white ball almost surely, which implies the stated claim. □ 

Davis pQ proved the well-known fact: a single urn with a classical reinforcement 
weight sequence (tfi)j £ Nu{o} £ (M + ) Nu {°} eventually fixates on a single color if and only if 
Y^Lo w^ 1 < oo. The following proposition extends this result in the setting of generalized 
reinforcement weight sequences. 

Proposition 1.2. If the sequence (fj)igNu{o} attains its minimum v := minj eNU { } Vi and 

\-{vi=y} 



E- 



< oo, 



then the urn eventually fixates on a single color almost surely. Otherwise, both black and 
white balls are drawn infinitely often almost surely. 

Proof. First note that if (f j)jgNu{o} does not attain its infimum, then there are infinitely 
many indices j G N such that Vj < Vi for all i < j. Then using Lemma [1.1( c). for each 
such j, there are j balls of each color in the urn at time 2j. We can therefore conclude 
that almost surely, balls of both colors are drawn infinitely often. 

On the contrary, if (fj)j e Nu{o} attains its minimum, denote by a(0), a(l), a(2)... the 
(finite or infinite) sequence of subscripts such that v a ^) = v := minj £ Nu{o} v j, for each i. 
Let us suppose first that this sequence is infinite. We can then use the classical time line 
argument of Rubin. 

urn 1 m £ ^ .^). g ( 3 ) 



l — f 1 1 1 

urn2 g0) ^(1) f(2) £'(3) g'(4) 



Figure 3: Rubin's time line technique 

The time interval indicated by £ (i) (or £'(«)) in the figure has length distributed as 
Exponential (rate u a u\) random variable, for each i e N. Moreover, all the Exponential 
variables are mutually independent. Note that by Lemma [1.1( c). at time 2a (0) there are 
almost surely a(0) black balls and a(0) white balls in the urn. Then one can construct 
a realization of the urn process from the time-lines just as in Davis p] (see e.g. also [3]) 
using the fact that if the current count of one color is at i such that = v, and of the 
other color is at j such that Vj > v, then the urn "deterministically" draws the latter 
color on this time step. The time-lines are used to decide the next draw on steps where 
both counts are contained in (a(z))j>o, that is when the draw is not deterministic. 
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If on the other hand, the sequence a(i) defined above is finite, let a* be the maximum 
of a(i). Then the urn will find itself in the situation analogous to that of Lemma [1.1( a) 
after finitely many steps, in the sense that the color for which the count becomes first 
higher than a* will be drawn forever after. □ 

Let us denote by it := {b, ro} N the set of all possible evolutions of an urn. If u G it, 
then for i G N, u(i) equals b (resp. to) if the ball drawn at time i is black (resp. white). 
Then it 2 is the set of all possible joint evolutions of the two urns. Let F C it 2 be the 
set of all evolutions of two urns such that both of them fixate on the same color, or more 
precisely; 

F := {(u, t>) G it 2 , such that 3n ,Vn > n ,u(n) = t>(n) = u(n )} 

Let us now state the first main result of this paper. From now on we consider the 
Generalized Interacting Urn Model (GIUM) with two urns (that is, U = 2). In the final 
section we address extensions to three or more urns. 

Theorem 1.3. If Wi = oo l (or equivalently Wi = {l,i)) and if the interaction parameter 
p < 1/2, then 



(l-p)(2-A.(p)) 



where 



C(P) 



2(l-p) 2 (l+p) 

2 p 3 _ Qp 2 + g p _ 4 



and A_(p) 



2(l-p/2) 2 



Remark The reinforcement weight sequence Wi = oo* could be replaced by any Wi = 
UiOO Vi with Ui = 1 and (vi)i increasing. The law of the GIUM is trivially equal to that of 
GIUM with Wi = oo\ Indeed, this law is entirely determined by the family (7T TO (i, 
and when (vi)i is increasing, we have ir w (i,j) = l{i>j} + l{i=j}/2. 

Note that if p > 1/2, we already know (Theorem 3.2 from [2]) that the two urns fixate 
on the same color almost surely. Therefore, the graph of 

p ^ P [F] 



is as follows: 




Figure 4: Fixation probability plot 
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Before proving Theorem 1 1.3 1 in Section [21 we explain our main motivation for obtaining 
this result, which concerns the limiting regime for the Interacting Urn with exponential 
reinforcement, where p — > oo. 

For any given p > 1 set w(p) = (p l )ieNu{o} ; let and w(oo) = (oo l ) ieNU { }. Denote by 
P p , E p (resp. Poo, Eqq) the probability laws and expectations induced by the reinforcement 
weight w(p) (resp. u>(oo)) onil 2 . 



In fact, in Section I2T21 we will enrich the filtration to also 
include the i.i.d. Bernoulli coin flips which tell us from which drawing pool (the urn itself 
or the two urns combined) are the draws made, and we will call the resulting laws again 
Pp,Poo- This should however not confuse the reader since the projection of the enriched 
laws to il 2 gives precisely the above defined laws. 



Theorem 1.4. We have 



lim Pp [F] = Poo [F] 



where the right-hand side equals the expression given in Theorem ! 1.3[ 



Note that F is a countable set, so we have 



Pp [F] = Pp 



U {(*>»)} 

(u,»)eF 



E p p[( u >°)i- 

(u,d)gF 



For any (u, o) £ F, it is relatively easy to show that 

lim Pp [(u, 0)] = Poo [(u, t>)] . 



p— >oo 



However, this convergence is not sufficient to prove the convergence of the series, and the 
most concise rigorous argument that we could find is perhaps surprisingly long. Since 
we use some elements of the proof of Theorem 11.31 in the proof of Theorem 11.41 this is 
postponed to Section [2T2l 



2 Proofs of Theorems 1.3 and 1.4 



Our first observation is that for all i,j G N, we have = tt(z — l,j — 1). This 

means that if an urn contains both black and white balls, one can withdraw one black 
ball and one white ball from this urn without changing the law of the next ball to be 
drawn. In other words, if an urn contains B black balls and W white balls with B > W, 
its behaviour is the same as the behaviour of an urn that contains B — W black balls and 
no white balls. 

This remark allows us to simplify the set of possible configurations for two interacting 
urns. Let us consider two urns, containing respectively Bi and B 2 black balls and W\ and 
W2 white balls. We can classify the possible configurations into three cases: 

Configuration 1. Bi + B 2 = Wi + W 2 - It also means that B\ — W\ = W 2 — B 2 , 
and according to the previous remark, this configuration is equivalent to a configuration 
in which one urn contains \Bi — W%\ = \B 2 — W 2 \ black balls and the other as many white 
balls. We denote this configuration by Cx(\B\ — W\\). 
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Figure 5: Several examples of two urns in configuration Ci(4). 

The configuration in which both urns are empty is denoted by Ci(0). 

Configuration 2. B 1 + B 2 ^ W x + W 2 and (B 2 -W 2 )(B 1 -W 1 ) < 0. This means that 
there is a global majority color in the two urns, but one of the two urns has a majority of 
the other color. Suppose without loss of generality that B\ + B 2 > W\ + W 2 , B\ > W\ and 
B 2 < W 2 . Note that starting from this configuration, all the balls drawn from the urn 1 
will be black almost surely. Therefore, the law of the next ball to be drawn starting from 
this configuration only depends on the difference W 2 — B 2 . We denote this configuration 
by C 2 (W 2 -B 2 ). 



OO 
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Figure 6: Several examples of two urns in configuration C2(2). 

Configuration 3. B x + B 2 j-W x + W 2 , and (B 2 - W 2 ){B 1 - W ± ) > 0. Here the 
global majority color is the same as the majority color in each of the two urns. Starting 
from this configuration, all the balls drawn will have the majority color, almost surely. 
We denote this configuration by C3. 

Since the two urns are initially empty, they stay for some time in Configuration 1 
and then jump to Configuration 2 (or possibly directly to Configuration 3). Once in 
Configuration 2, they can either stay in Configuration 2 forever, or jump to Configuration 
3, and stay there forever after. A typical evolution of this process is schematically depicted 
by the following figure: 



oototoooooooooo 

IIOIOOIOIIOOOOO 



Configuration 1 Configuration 2 Configuration 3 
Figure 7: The three phases of the evolution. 
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2.1 Proof of Theorem [L3 

For £ > we denote by 

q e = q f (p) := P [The two urns fixate on the same color starting from configuration C\ 
and 

r£ = r|(p) := P [The two urns fixate on the same color starting from configuration C2 

As already noted, starting from configuration C3, the probability that the two urns 
fixate on the same color equals 1. We proceed by observing that, due to the Markov-like 
property, some simple relations connect these different probabilities. 

Starting from Ci(0), each urn independently draws a white or black ball with prob- 
ability 1/2. Therefore with probability 1/2, the two urns draw the same color and im- 
mediately (at time 1) enter the configuration C3, and with probability 1/2 the two urns 
choose different colors and jump to configuration C\{t) at time 1. This implies 

1 1 

For I > 1, starting from Ci(£), the urns can jump to C\{£ — 1), C\{1 + 1) or Ci{£ — 1), 
and this decision is made independently form the past. More precisely: 

• They jump to configuration G\{1 — 1) if and only if each urn draws a ball of the 
color which is not its majority color. In order that this happens, for each of the 
urns the drawing must be done in the two urns combined (with probability p) and 
the minority color of the urns combined must be chosen (with probability 1/2). So 
the probability of this move equals (p/2) 2 . 

• They jump to configuration C\[£ + 1) if and only if each urn draws a ball of its 
majority color. This happens with probability ((1 — p) + p/2) 2 = (1 —p/2) 2 . 

• They jump to configuration C2(£ — 1) if the two urns draw a ball of the same color. 
This happens with the remaining probability p(l — p/2). 

This implies the following sequence of relations: 

Qi = (f)Vi + *>1- (2) 

Starting from configuration 6*2(0), the urns either jump to configuration C3 with prob- 
ability (1 +p)/2, or to configuration 6*2(1) with probability (1 — p)/2. We conclude that 

Similarly, for £ > 1, starting from configuration C^), the urns either jump to config- 
uration Ci{£ — 1) with probability p, or to configuration C<i{£ — 1) with probability 1—p, 
again independently of the past. This translates into 

ti = pr^_i + (1 - p)r e+ i- (4) 
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In fact, the above reasoning shows that if Y n is an integer- valued random variable such 
that at time n, the urns are in configuration C2(Y n ), then (Y^ Atq , k > n) is the simple 
random walk with drift l — 2p killed at To := inf{j > n : Yj = 0}. It is well known (recall 
that p < 1/2) that P(ro < oo | J- n ) — p/(l — p) on {Y n = 1}, yielding n = Y^ r 0; an d 
together with (j^J) this gives r = ^zf- Now one can deduce by induction from (J4j) that 

i +p ( p y 

2-p\l-pJ 

We then introduce these values into (EI) to obtain 



«=(|)V. + (l-f)V 1 + ^( T ^l (5) 



Define a function 

oo 



e=o 



Differentiating both sides and applying (J5J) we get 

oo 



i 



(£-1)1 



\^ ( fP\ 2 (, P\ 2 , P(l+P) f P \ \ x e 1 

*- i+ i i -2j vt^j j(T 



(£-1)! 



(f) 2 E^ + (i-f) 2 f:. +2 (4 + ^f;^ 

fcO fcO £=0 

p\ 2 / p\ 2 „. p(l+p) ( px 



!) /,(*) + (i - 1 ) 



H exp 



,2; J ' JK ' \ 2) Jpy ' 2 \1-P 

So / p is a solution of the ODE 



(i-f)V-^ + (f) , , + ^«p( I ^)=a (6) 



The characteristic polynomial of the homogeneous ODE is 

(i-f) , *.- A+ g) 1 -* 

and its two solutions are 



A+(») = 1 7y = 1 7y • (7) 

2(1 -p/2) 2 2(1 -p/2) 2 
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So the general solution of the homogeneous equation is of the form 

fp(x) = A(p) exp (X-(p)x) + B(p) exp (X + (p)x). 

Let us now search for a particular solution to (jSJ) of the form f£(x) = C(p) exp(xp/ (1— p)). 
Plugging it into (jSJ), we obtain 

2(l-p) 2 (l+p) 
C{P) = - 2p 3- 6p2 + 9p -4 • (8) 

Hence the general solution to ([6]) is of the form 

f P i x ) = /pW + fp(x) = A(p) exp (A_(p)ar) + S(p) exp (A+(p)x) + C(p) exp (73^ 
In order to find and B(p), note that since < 1 for all £ > 0, we have 

OO ^ OO £ 

So = o(exp (A+(p)a;)) since A+(p) > 1 as can be easily checked. Therefore we deduce 
that B(p) = 0. We can now find A(p) from the following linear system: 

q = f p (0)=A(p) + C(p) 
Si = /;(0) = i4(p)A_(p) + C7(p) I ^ • 



Recalling (jTJ) we then obtain 



A(p) + <7(p) = i + i fi4(p)A_(p) + C7(p) : 7; 



2 2 V 1 -P 

and deduce that 

A(p)= l-p + C(p)(3p-2) 



(l_p)(2-A_(p)) ' 
Therefore 

where C(p) and A_(p) are as in (j£J) and ([7]), respectively, concluding the proof of Theorem 

One can check in particular that C(0) = 1/2, C(l/2) = 1, A(0) = A(l/2) = 0, and so 

9o (0) = l/2 and g (l/2) = l. 

Indeed, when p = the two urns are independent and the probability that they fixate on 
the same color is 1/2, while p — 1/2 is the critical phase of the IUM, for which we already 
knew that the two urns fixate on the same color, almost surely (see Theorem 3.5 in [2]). 
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2.2 Proof of Theorem ITU 



In most of this argument we do not fix some p G (l,oo] but rather consider the whole 
family of laws P p , p G (1, oo]. Denote by S& the state of the two (generalized) interacting 
urns at time k. The reader should think of Sk as a "struct" that contains the count of 
black and white balls for each of the urns at time k, as well as the information on the 
drawing pools used at time k — 1 (for the draws made to update the state at time k from 
the state at time k — 1). Denote by T = (J-fc)fc>o the filtration generated by the process 
S, that is, J-fc = <r{S n : n = 0, . . . , k}. Define furthermore U\ := 0, 

a 2 := M{k >0:S k E U^C^i)}, a 3 := mf{k > : S k G C 3 }. 

Clearly, all the <7j are stopping times with respect to J 7 . As depicted in Figure 7, we have 
Poo(o"i < #2 A 03 < 03) = 1. As argued in the course of the proof of Theorem ll.3[ we also 
have that if S k G C 2 (£) for some k and i > 1, then P^S^i G {C 2 (£-l), C 2 (£+l)}) = 1. 
Similarly, if S k G 6*2(0) for some k then Poo^+i G {C 2 (l), C 3 }) = 1, and if Sk G C 3 then 
Poo(^ fc+ i G C 3 ) = 1. Therefore 

F = {03 < 00}, — almost surely. 

Our main problem in proving the current result is related to the fact that most of the 
above statements fail to hold under P p if p < 00. 

Let A be following event: there exist some m G N and an urn u such that the color 
of the ball drawn for u at time m is the minority color in the drawing pool prescribed 
by the corresponding Bernoulli (p) flip (if 1 this pool is the two urns combined, otherwise 
this pool is the urn u itself). Such a draw is asymptotically impossible, or equivalently 
Poo (A) = 0, and henceforth we will refer to it as "Al-draw". Let A be the complement of 
A. Our strategy is to show the following two points. 

Lemma 2.1. (i) lim^ F P [F n A] = F^F n A] = P^F], 

(ii)F p [FnA] = 0{i/p). 

Let t := inf{k > : Sk is a result of an Al-draw}, with the usual convention that 
r = 00 if such a draw is never made. Then is it clear that r is a stopping time with 
respect to T (for each p G (1, 00)). 

Our interest in r comes from the observation that the state of the two urns changes 
according to the same general pattern (depicted in Figure 7) under F p and under P^o 
until the time of the first Al-draw, where the transition probabilities depend on p. More 
precisely, we have 0\ = o\ A r < r A o 2 A 03 < r A 03, and also if Sk G C 2 {t) for some 
k < t and i > 1, then either {r = k + 1} or {r > k + 1, S fe+ i G {C 2 (^ - 1), C 2 {1 + 1)}} 
happen P p -almost surely. Furthermore, if Sk G 6*2(0) for some k < r, then P p (r = 
k + 1) + P p (r > fc + 1, Sfc+i G {C 2 (l), C 3 }) = 1 and if S k G C 3 for some fc < r, then 
P p (r = fc + 1) + P p (r > k + 1, G C 3 ) = 1. Therefore, F n A = {a 3 < 00, r = 00} and 
more importantly F H A = {a 3 < 00, r < 00}, P p -almost surely, for any p G (1, 00]. 

In order to show part (i) of Lemma I2.1[ we note that the probability of any path (in 
the countable set of infinite paths) contributing to F fl A is a product of finitely many 
terms of the form cx f b with c G {!,£>, 1— p} and a > b (otherwise, there would exist an 
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Al-draw along the path) and infinitely many terms of the form p x p f +pb + (l—p) x p f +pd , 
where again a/b A c/d > 1. Therefore for each infinite path -it £ F (1 A, 

p ^ w 

increases to Poo(7r) and so by the monotone convergence theorem, we have lim^oo P p (Fn 
A) = Poo(F n A) = Poo(F), where the last equality is due to ¥ oo (A)=0. 

Arguing part (ii) of Lemma ET] turns out to be more tricky. First note that F p (F(lA) = 

F p (a 3 < oo,t < oo) < P p (r < a 2 Aa 3 ,a 3 < oo)+P p (cr 2 < r < a 3 < oo)+P p (a 3 < r < oo). 

The final term above is the simplest one to study so we consider it first. Indeed, at time 
a 3 the count of the global majority color for all the pools (each of the urns, and therefore 
the urns combined) is at least by one higher than that for the minority color. Moreover, 
as long as the two urns remain in state C 3 (which is certainly true until time r), the count 
of the majority color for all the pools (each of the urns, and therefore the urns combined) 
increases by at least one in each step. Therefore, by nested conditioning with respect to 
J- a3+ i, we have 

F p (a 3 < t < oo) = 
< 
< 

Note that o 2 A a 3 is a finite (even stochastically bounded by a geometric, see the 
proof of Lemma 12.21 below) random variable under P p , for each p. We split the event 
{t < a 2 A a 3 } according to the state of the system at time r — 1 and the value of r. Note 
that Al-draw is impossible from state Ci(0), for any p G M + . Also note that a 2 < cr 3 (in 
words, the two urns enter Ui> C 2 (£) at the exit time from UjCi(i)) unless S , - 2Ao - 3 „i G C*i(0) 
in which case the two urns jump directly to C 3 . Thus 

P p (i" < o 2 A cr 3 , cr 3 < oo) = 

< 
< 

< 
< 



Y P p(°"3 < oo, a 3 + i < r, o- 3 + i + 1 = r) 

i=0 

00 ^ 
^F p (a 3 <oo,a 3 + i<T)-— — 

i=0 H 



J^P^SV-i G Ci(i),T < a 2 ,cr 3 < 00) 
i=i 

00 00 

Yl P ^ r > k ~h Sk-i eC 1 (i),r = k, a 3 < 00) 

i=l k=0 

00 00 j 

i=l fc=0 P 
00 J 

-E(#{steps in C±(i) before r}; cr 3 < 00) 

i=i P 

O ( - J E(#{steps in Uj Ci(z) before r}; a 3 < 00), 
VP/ 
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where the inequality in the third line is again obtained by nested conditioning with respect 
to J-jfc-1 and the fact that on {Sk-i G C\(i)} the difference in the counts of majority and 
minority colors is equal to i. 

In an analogous fashion (we leave the details to the reader) one can obtain 

P p (o"2 < r < cr 3 < 00) < O (-) E(#{steps in U* C 2 (i) before r}; a 3 < 00). 



Lemma 2.2. Fix p G (0, 1/2). There exist po < 00 such that for each p > po we have 

E p (r A cr 3 • l{ CT3<0 o}) < C, 
where C is a finite constant which depends only on p. 
Since, due to the above calculations, 

P P (F nA) = ^-J (1 + E(#{steps in U i=1>2 UiCj(i) before r}; a 3 < 00), 

and the expectation on the right-hand side above is precisely E p (r A 03 • l{ cr3<00 }), we 
obtained the required claim, and this completes the proof of Lemma 12.11 and in turn the 
proof of Theorem 11.41 

Proof of Lemma \2.2i Note that 

E p (r A cr 3 ■ l{ CT3 <oo}) < E p (r A o 2 A a 3 ) + E p ((r A ct 3 - r A a 2 A cr 3 ) 1 {ct3<oo} ). 

Again, bounding the first expectation on the right-hand side above is simpler. For this, 
note that on {k < a 2 Acr 3 } the two urns have a probability uniformly bounded from below 
by 2(p/2) 2 = p 2 /2 > for a 2 to happen at step k, since for this it is sufficient that the 
draws for both urns are made from the two urns combined, and that the same (equally 
likely) color is chosen for both. Therefore, as already mentioned, the random variable 
02 A CT3 is stochastically bounded by a geometric random variable with success probability 
p 2 /2. We conclude that r A o 2 A cr 3 has expectation bounded by 2/p 2 under any P p , for 
p G (l,oo]. 

To bound E p ((r A a 3 — r A o 2 A a 3 ) 1{ - 3<00 }), we use the fact that on {a 2 < a 3 } 
(WLOG we can and will assume that this happens), under ¥ p , the steps of the two urn 
model during the time interval [r A a 2 , t A er 3 ] go through the classes C 2 {i) according to 
the pattern illustrated by Figure 7. More precisely, it is easily seen that 

Pp(°"3 = k + 1 I J 7 fc)l{r>fc,5 fc eC 2 (0)} = ^p(S k+ i G C 3 I J r fc )l{ r>fci 5 fceC , 2(0)} ^ 

uniformly in k, and moreover that for any £ > 1 and any fceN. on {r > fc, 5^ G C 2 (£)} 

P p (5 fe+1 G C 2 (l + 1), r > A; + 1 1 T k ) = (1 -p){l + M+1 (p)), 

P p (^ +1 G C 2 (£ - 1), r > k + 1 1 J- fc ) = p(l + M _!(p)), liUj 
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where for each k and all £ G N, Ok,e+i{p),Ok,e-i{p) axe .Ffc-measurable random variables 
satisfying the following important property: there exists some C < oo such that 

Pp(0 M _i(p) < C/p) = P p (0 M+1 (p) < C/p) = 1, VM e N, p g (l,oc). 

Now fix some p G (1, oo). On {02 < r AT3}, the two urns enter the set of configurations 
U^C^) via 6*2(1), where I is such that S a2 G C^J), P p -almost surely. Due to the 
reasoning used in bounding E(r A(T 2 A cr 3 ), J is stochastically bounded by a geometric 
random variable with success probability p 2 /2. Recall the process Y n defined in the 
paragraph which contains relation ([II) . Note that the same definition for Y makes sense 
under P p (at least) until time r, and recall the stopping time r = inf{j > n : Yj At = 0}. 

Due to ([9]) , there are at most geometric (with success probability 1/4) many excursions 
of Y Ar above before 03. The first excursion starts at / and ends at 0, while all the 
others start and end at 0. Due to (fTUl) . all the excursions but (possibly) the first one are 
"identically distributed up to an error of order (1 + C/p) excursion len s th "_ By this we mean 
that for a fixed excursion path e away from 0, the probability that the kth excursion 
above takes value e equals p(e)x(l + gk(p, e))' e ' where p(e) depends only on the steps in 
e, |e| is the number of steps in e, and \gk(p, e)| < C/p for all k, p, e. In the sequel, we will 
explain this even more precisely. Due to Wald identity, we now know that for bounding 
E p ((r A cr 3 — r A a 2 A er 3 ) l{ - 3<00 }), it suffices to show that both 

^(1 -p 2 /2) i - 1 E p (T ;r < oo\Y = i) < 00 (11) 

i 

and E(t ; r < oo|F = 0) < 00. The excursion starting at i and ending at can again be 
split into i almost identically distributed excursions (due to (jTUl) ). where the jth excursion 
starts at i — j + 1 and ends at the time of the first visit to level i — j, j = 1, . . . , i. Denote 
by Tj the time of the first visit to level j. Therefore, bounding E p (ro; t < oo\Y = i) for 
i > 1 amounts to bounding J2]=i ^p( r «-i — T i-j+u T %-j < oo\Y = i). 
Now due to ffTUl) . we know that 

E p(^-i - n-i+i; n-j < oo\Y = i)< E(r^ • (1 + C/p) T °; t' q < oo|F ' = 1), l<j< i, 

where Y' is now the simple asymmetric random walk with F(AY' = 1) = 1 — p = 
1 — P(AY' = — 1) (as it is under P^) and r' is its corresponding tq. With a finite upper 
bound B for the expectation on the right-hand side in the last display, we would have 
E p (to; r < oo|y = 1) < ix B and this would make the sum in ffTTT) bounded by a multiple 
of B, that would depend only on p. Furthermore, since trivially E p (r ; r < oo|F = 0) = 
1 + Ep(r ; To < oo\Y = 1) (the walk Y is reflected at 0), one sees that a uniform (in large 
p) upper bound on 

E(r -(l + C/p) r o;^< oo|Y ' = l) 

is sufficient to conclude the argument. 

The next step is to condition on Tq < 00. It is well-known (and easy to check) that the 
law of Y' (simple asymmetric random walk with bias 1 — 2p > 0), conditioned on Tq < 00, 
becomes the law of the simple asymmetric random walk Y" with bias 2p — 1 < 0, where 
P(AY" = 1) = p = 1 — F(AY" = — 1). Due to the well-known correspondence between 
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the excursion of Y" and the subcritical Galton- Watson branching (of geometric offspring 
distribution with success probability (1 — p) and mean 1/(1 — p) — 1 < 1), one can easily 
see that there exists A > 1 such that 



E(A T( ") = E(\ 2Z ) < oo, 



where Z is the total population size of the above Galton- Watson process, started from 
a single individual. Denote by Z m the total size od the first m generations. Then, by 
conditioning on the size of the first generation, one obtains that 

E(*A") = v ■ (1 -p) ■ 1 z m > 1, v > 0. 

1 — p • E^™- 1 ) 

Consider 

1 

g = V.(l-p). - , 

l-p-g 

and note that if z/ = vo(p) — (4p(l — p))^ 1 > 1 (recall that p < 1/2) one can solve 
the above equation for all v G [0, z/ ] to obtain a functional solution g p (^), continuously 
increasing in v. Since clearly for v G (l,^o] we have E(z/ Zo ) = v < (7 p (z/) and since 
x < (7 p (z/) implies (1 — p) ■ ^ < g P (v), one concludes that sup m E(^ Zm ) = lim m E(z/ Zm ) 
is finite for v e [0, z/ ], and furthermore that g v {y) must equal E(z/ Z ). 

Now for the above z/ we pick A G (1, y^), and then p such that 1 + C/ po < A. Then 
there exists n such that for all p > po 

n{l + C/p) n < n{\ + C/p ) n < A n , Vn > n , 

and so we finally have that for all p > Po 

E« • (1 + C/p) r o ) < n A"'° + E(A T( ") = A n ° + G p {\ 2 ) < oo. 



3 Concluding remarks 

The following remarks lead to natural open questions. 

1. Suppose that p = oo. In the case of Interacting Urn Models with more than two 
urns, one can easily derive the law of the number of non- conformist urns (that is the 
number of urns that do not fixate on the majority color, see [2]) when the number 
U of urns is odd. Indeed, if U is an odd number then the majority color in the U 
urns combined is necessarily decided at the very first step. Then all the urns that 
have chosen the majority color immediately fixate and and all the urns that chose 
the minority color are in configuration 6*2(1), and each eventually fixates on the 
majority color with probability 

ri(p) 



[l-p)(2- P y 
independently of the others. 
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If the number U of urns is even and strictly bigger than two, then we can still 
write the probability of fixation as the countable sum of all the urn paths until the 
majority color is decided but it seems more difficult to figure out an explicit formula 
for this expression (as the one given by Theorem ll.3p . 

2. Suppose that p = oo. If there are more than two colors and U = 2, then generalizing 
our results is trivial. Indeed, if there are C > 2 colors to start with, then the two 
urns draw the same color at the first step with probability 1/C and they draw two 
different colors with the remaining probability (C — 1)/C. In the former case the 
model starts from configuration C3 and the two urns fixate on the chosen color. In 
the latter case, the model starts in configuration Ci(l) and the two urns fixate on 
the same color with probability qi(p). If there are more than two urns, then the we 
cannot conclude much from the results of this paper. 

3. Theorem 11.41 can also be generalized for U > 2 and C > 2. In fact, the proof 
that lim p _ s . 0O F p [A] = P^ [A] is exactly the same (recall that A is the set of all 
asymptotically possible urn paths). The proof that linip^oo P P [A] = needs to be 
adapted but can be done in the same fashion. The idea is that if an urn path is in 
A then it has an Al-draw, and its probability is at least p times smaller than the 
same urn path without this Al-draw. Thus P p [A] = 0(p _1 ) which proves the limit. 
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